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Abstract:  In  the  highly  heterogeneous  environments  of 
coalition  operations,  sharing  sensor-originated  informa¬ 
tion  with  desired  quality  characteristics  is  key  to  the  ef¬ 
fective  execution  of  coalition  tasks.  A  characterization  of 
the  quality  of  information  (Qol)  is  useful  in  many  contexts 
and  can  be  invaluable  in  making  decisions  such  as  trust¬ 
ing,  managing,  and  using  information  in  particular  appli¬ 
cations.  However,  the  manner  of  representing  the  Qol  is 
highly  application-dependent.  This  leads  to  divergent  Qol 
characterizations  and  manifestations  hampering  the  effec¬ 
tive  and  streamlined  execution  of  coalition  tasks.  An  ap¬ 
plication-agnostic  Qol  specification  can  provide  consis¬ 
tency  in  the  representation  of  information  and  its  quality, 
and  enable  Qol-aware  determinations  across  many  dif¬ 
ferent  applications.  In  this  paper,  an  application-agnostic 
Qol  model  which  can  be  readily  customized  to  the  needs 
of  specific  applications  is  presented.  Object-oriented 
modelling  principles  are  leveraged  to  attain  a  Qol  model 
that  can  be  used  in  many  different  contexts. 1 
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1  Introduction 

Attaining  information  superiority  is  the  cornerstone  of 
the  modern  network-centric  operations  (NCO)  model  in 
the  execution  of  military  operations  [1][2]  of  allied,  coali¬ 
tion  forces.  Distributed  sensor  systems,  comprising  a  mix 
of  both  physical  and  non-physical  (human)  sensors,  have 
become  essential  building  blocks  for  supporting  the  NCO 
objectives.  The  fusion  of  sensor-originated  data  and  de¬ 
rived  information  is  used  to  support  increased  situational 
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awareness  and  ultimately  intelligent  decision  making  and 
effective  action  taking. 

Sensor  systems  are  deployed  in  and  around  the  theater 
of  operation,  forward  operating  bases,  and  so  on,  and  faci¬ 
litate  the  collection  of  relevant  or  pertinent  information. 
These  systems  may  have  been  designed  and  deployed  for 
specific  purposes  or  (as  a  result  of  their  increased  mobili¬ 
ty,  processing  and  communication  capabilities)  deployed 
in  ad  hoc  manner  to  support  sensing  tasks  on  demand.  No 
matter  what  their  mode  of  deployment  and  operation  is, 
the  collection,  storage,  indexing,  search,  and  dissemination 
of  pertinent,  sensor-originated  information  over  compute¬ 
rized  systems  is  crucial  to  situation  analysts  and  decision 
makers  alike  to  prepare  for  or  react  to  situations  of  con¬ 
cern  efficiently  and  effectively. 

Sensors  collect  data  that  encode  information  about  ob¬ 
jects  of  interest.  Given  models  about  such  information 
encoding,  the  data  from  one  or  multiple  sensors  can  be 
fused  and  extract  (i.e.,  infer)  the  sought  after  information. 
From  the  data  collected  by  a  sensor  network,  information 
about  several  objects  from  the  theater  of  operation,  e.g., 
the  battlespace,  can  be  extracted  and  situation  awareness 
attained,  as  outlined  by  the  layered  JDL  fusion  model  [3], 
To  achieve  the  desired  situational  awareness,  this  informa¬ 
tion  must  be  disseminated  to  the  appropriate  end-user 
processes,  e.g.,  human  analysts.  It  is  thus  becoming  impor¬ 
tant  that  information  is  summarized  in  some  fashion,  so 
that  end-users  can  digest  it.  Furthermore,  provenance  be¬ 
comes  important  so  that  its  users  can  perform  a  deep  dive 
into  the  detailed  information  (or  sensor  data)  that  supports 
the  summary.  The  overall  quality  of  the  information  that  is 
presented  to  the  end-user  significantly  impacts  the  ability 
of  the  user  to  take  appropriate  action. 

As  a  simple  example  of  the  impact  that  the  quality  of 
the  provided  information  could  have  on  its  end-use,  con¬ 
sider  a  deployment  of  an  array  of  acoustic  sensors.  If  this 
array  were  to  support  an  intruder  detection  functionality 
then  it  might  need  only  to  operate  at  a  low  sampling  rate, 
say  1  Hz  or  less.  However,  if  the  array  were  to  support 
intruder  identification  as  well,  the  array  might  need  to 
reproduce  the  noise  spectrum  of  the  intruder  to  facilitate 
necessary  pattern  matching,  thus,  requiring  it  to  operate  at 
a  much  higher  (Nyquist)  sampling  rate. 
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In  coalition  environments,  components  of  the  end-to- 
end  information  path  from  the  sources  to  the  users  includ¬ 
ing  the  sensor,  communication,  and  information 
processing  systems  may  belong  to  a  variety  of  organiza¬ 
tions  and  coalition  members.  Hence,  for  effective  coalition 
operations  in  support  of  the  accelerated  operational  tempo 
expected  by  NCO  operations  [2],  information  collected 
and  managed  by  one  coalition  member  should  be  searcha¬ 
ble  and  retrievable  (in  original  or  modified  form)  by 
another.  To  achieve  this  goal,  it  is  necessary  that  a  com¬ 
mon,  yet  flexibly  expandable,  basis  for  searching  and 
retrieving  information  must  be  established  across  coalition 
members.  This  common  basis  must  be  easily  communica¬ 
ble  (i.e.,  be  interpretable)  to  and  supportable  (i.e.,  be  trans¬ 
formable)  by  information  processors  (e.g.,  fusion  opera¬ 
tors)  owned  and  execute  by  the  various  coalition  members. 
With  increasing  amount  of  sensor-originated  information, 
to  support  effective  searching  for  pertinent  information, 
this  common  basis  must  facilitate  information  enrichment 
using  metadata  to  hasten  the  search  rate  for  pertinent  in¬ 
formation  and,  hence,  increase  the  capacity  of  the  informa¬ 
tion  assessment  process.  Acknowledging  the  importance 
that  quality  of  information  plays  in  achieving  desired  re¬ 
sults  (situation  awareness,  decision  making,  action  taking, 
etc.),  it  is  a  central  premise  of  our  research  that  quality  of 
information  (Qol)  can  serve  key  role  in  establishing  the 
aforementioned  common  basis  for  the  purpose  of  index¬ 
ing,  searching,  and  exchanging  pertinent  information  be¬ 
tween  coalition  members. 

The  area  of  Qol  has  been  extensively  studied,  typically 
under  the  term  information  quality  (IQ),  in  the  enterprise 
(for  information  collected  and  stored  in  data  warehouses) 
and  on-line  (for  information  searched  through  Web- 
engines)  areas  [4][5][6].  This  paper  considers  sensor- 
originated  information  in  the  context  of  military  situations. 
Such  information  introduces  new  challenges  for  the  quali¬ 
ty  of  information  required  to  support  mission-critical  situa¬ 
tion  awareness  and  decision  making  at  various  scope  le¬ 
vels  that  is  persistently  updated  according  to  the  dynamic 
and  unpredictable  nature  of  coalition  operations.  The  con¬ 
tributions  in  this  paper  are:  (a)  the  introduction  of  a  Qol 
framework  based  on  a  separation  of  responsibilities  prin¬ 
ciple  between  quality  and  value  of  information;  ( b )  the 
introduction  of  a  collection  of  information  processor  deal¬ 
ing  with  generation,  alteration,  and  communication  of  Qol 
metadata;  and  (c)  an  application-independent  UML-based 
data  model  for  the  Qol  metadata. 

This  paper  is  organized  as  follows:  In  section  2,  we  in¬ 
troduce  Qol  in  the  context  of  our  research,  and,  in  section 
3,  we  propose  a  Qol  framework  based  on  a  quality  vs. 
value  of  information  split,  along  with  related  vocabulary, 
and  an  abstract  representation  of  a  usage  model  of  sensor- 
originated  data  and  derived  information.  In  section  4,  we 
provide  the  overview  of  the  approach  and  rationale  for  the 
use  of  the  UML  representation  for  modelling  Qol  and  then 
present  our  Qol  metadata  data  model.  In  section  5,  we 
provide  an  example  of  Qol-related  metadata  for  a  shooter 


localization  application  in.  We  close  with  a  summary  in 
section  6. 

2  Quality  of  information 

Information  is  gathered  to  build  knowledge  and,  hence, 
gain  an  understanding  of  parts  of  the  real  world  that  are  of 
interest  so  that  appropriate  actions  can  be  decided  upon. 
The  time  horizon  for  building  this  understanding  may  be 
long  (weeks,  months,  and  years)  as  when  studying  the 
purchasing  habits  of  consumers,  or  the  migratory  trends  of 
population,  or  short  (minutes,  seconds,  or  subseconds)  as 
when  tracking  incoming  missiles  or  localizing  a  shooter’s 
location. 

The  degree  of  understanding  of  the  world  depends  on 
the  degree  of  pertinence  of  the  information  gathered  to  the 
situation  at  hand  -it  depends  on  the  quality  of  the  gathered 
information.  Qol  for  dynamic,  sensor-originated  informa¬ 
tion  relates  to  the  ability  of  using  information  to  draw  on, 
place  on,  and  annotate  a  map  of  situation  elements  of  in¬ 
terest  accurately  and  quickly.  Examples  of  such  ability 
include  placing  the  location  of  a  shooter  on  a  geographical 
map  relative  to  my  (the  end-user)  surroundings,  annotating 
the  shooter’s  location  with  a  foe  or  friend  information, 
drawing  the  trajectory  of  his  shooting  relative  to  my  posi¬ 
tion,  doing  so  within  3  seconds  of  the  shooting,  and  so  on. 

To  enrich  the  “situational”  map  with  the  aforemen¬ 
tioned  information,  data  from  a  number  of  sensors  (acous¬ 
tic,  seismic,  infrared,  imaging,  etc.)  may  be  dynamically 
summoned  and  fused.  Clearly,  the  accuracy,  speed,  preci¬ 
sion,  and  so  on,  of  our  ability  to  enrich  the  situational  map 
depends  on  many  factors  related  to  the  gathering,  trans¬ 
port,  management,  and  processing  of  pertinent  informa¬ 
tion.  Unfortunately,  not  all  of  these  factors  are  under  our 
complete  or  even  partial  control. 

The  variety  of  sensor  information  available  to  informa¬ 
tion  consumers  is  important,  useful  or  appropriate  at  dif¬ 
ferent  levels  for  their  particular  tasks.  For  example,  a  vid¬ 
eo  feed  of  a  track  moving  through  a  neighborhood  is  irre¬ 
levant  to  a  shooter  localization  task  but  may  be  relevant  to 
a  general  surveillance  task.  Given  that  there  is  invariably 
more  information  to  process  than  the  resources  available 
to  process  them,  one  needs  to  prioritize  among  the  differ¬ 
ent  possible  sensor  streams  for  any  type  of  application. 

Quality  of  information  is  the  basis  on  which  the  priori¬ 
tization  means  of  information  can  be  built.  A  measure 
associated  with  the  sensor  information  stream  that  can 
measure  its  quality  would  be  valuable  in  many  such  deci¬ 
sions.  We  can  see  evidence  of  this  in  the  effectiveness  and 
efficiency  in  enterprises  that  have  benefitted  from  a  ma¬ 
ture  research  and  implementation  base  dealing  with  infor¬ 
mation  quality  [7],  and  this  base  moves  quickly  with  the 
times,  taking  into  account  the  limitations  on  shared  under¬ 
standing  between  different  parts  of  a  large  organization 
[8][9].  Approaches  to  formalize  the  understanding  of  in¬ 
terplay  between  disparate  information  sources  are  neces¬ 
sary  for  some  level  of  guarantee  of  generalization  and 
future-proofing  of  hard-won  implementations  of  such 
approaches. 
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For  specific  application  contexts,  there  exist  quality 
descriptions  and  metrics  available,  such  as  the  Civil  NIIRS 
reference  guide  for  imagery  quality  [11],  the  SIAP  metho¬ 
dology  for  evaluating  “...the  quality  of  air  vehicle  portion 
of  the  Single  Integrated  Air  Picture  (SIAP)...”  [12],  and 
the  EuroRoadS  program  for  intelligent  transportation  sys¬ 
tems  [13].  However,  there  is  no  general  framework  or  a 
common  model  for  Qol  which  can  be  used  for  dealing 
with  Qol  especially  for  dynamic  sensor-generated  data  in  a 
generic  manner.  There  are  many  benefits  in  having  a 
common  model  for  characterizing  the  Qol  of  sensor  in¬ 
formation  streams.  A  common  model  can  provide  cohe¬ 
rency  among  different  types  of  information  streams.  Al¬ 
though  there  will  be  variations  between  the  quality  metrics 
and  models  that  will  be  dependent  on  the  specific  applica¬ 
tion  context  of  the  information,  a  common  model  can 
provide  a  common  ground  for  many  of  the  metrics  that  can 
be  shared.  Furthermore,  a  common  quality  of  information 
model  can  provide  the  context  for  an  application-specific 
Qol  model,  and  provide  a  base  model  from  which  applica¬ 
tion-specific  models  can  be  developed.  Last  but  by  no 
means  least,  coalition-based  operations  involve  collections 
of  authorities,  processes,  doctrines,  communication  proto¬ 
cols,  and  so  on,  that  dynamically  get  together  for  the  ex¬ 
ecution  of  tasks  of  common  interest.  Establishing  common 
principles  and  policies  for  exchanging  and  sharing  not 
only  information  but  quality  metadata  about  this  informa¬ 
tion  is  undoubtedly  an  important  facilitator  for  effective 
collaboration  between  the  coalition  forces. 


3  Qol  framework 

3,1  The  Qol/Vol  split 


intermediary  decision  centers 

Figure  1:  The  end-to-end  information  flow  path 
Traditionally,  sensors  are  deployed  in  conjunction  with 
their  applications  -a  monolithic  relationship.  However,  the 
on-demand,  just-in-time  deployment  of  sensor-enabled 
applications  expected  during  NCO  coalition  operations 
requires  creation  of  elaborate  sensor-based  services  with 
on-the-fly,  dynamic  binding  capabilities  to  available  sen¬ 
sor,  information  management,  and  communication  re¬ 
sources.  Figure  1  shows  such  an  example,  where  end-user 
applications  retrieve  needed  information  from  a  collection 
of  information  sources  by  engaging  any  number  of  com¬ 
munication  networks  (which  may  include  ad  hoc,  mobile 
networks  that  are  deployed  for  missions  not  specifically 
designed  for)  and  information  processing  centers.  The 
example  shows  an  application  app ,  having  information 


needs  for  items  ( a,f,y,S )  and  retrieving  only  items 
(a’, /?’, S’)  possessing  desirable  quality  characteristics. 

The  example  in  Figure  1  can  be  abstracted  to  the  ge¬ 
neric  scenario  shown  in  Figure  2,  which  will  serve  as  our 
basis  for  our  Qol  framework.  Specifically,  information 
originates  from  information  sources,  which  may  include 
sensors  of  various  types  and  capabilities,  as  well  as  human 
intelligence.  The  information  from  a  source  passes  through 
a  channel  to  reach  the  receiver  of  the  information.  The 
receiver  of  the  information  could  be  a  human  analyst  or  an 
automated  software  module  performing  operations  such  as 
information  fusion  or  using  the  received  information  for 
applications  such  as  target  tracking,  intruder  detection  or 
military  planning.  In  general,  sources  and  receivers  are 
functional  entities  residing  in  nodes  accessible  over  inter¬ 
connected  physical  networks.  A  node  can  be  a  receiver  for 
one  information  stream,  while  a  source  for  another.  Infor¬ 
mation  transport  channels  daisy-chain  source  and  receiver 
functions  linking  collections  of  end-sources  to  collections 
of  end-receivers. 


Information  Stream 
- > 


> 

K 

f  A 

Source 

Channel  y 

Receiver 

_ , 

V 

s, _  _ J 

Figure  2:  Abstract  use  scenario  for  the  Qol  framework 

The  quality  of  information  will  ultimately  reflect  upon 
its  end-use.  However,  the  unpredictable  variety  of  end- 
uses  of  a  piece  of  information  and  role  that  a  given  piece 
of  information  could  play  in  the  context  of  these  end-uses 
presents  us  with  a  compelling  challenge.  To  address  this 
issue,  we  have  elected  to  split  the  holistic  Qol  characteri¬ 
zation  into  one  that  relates  to  the  inherent  properties  of 
information,  and  one  that  relates  to  the  role  of  this  piece  of 
information  in  the  context  of  its  end-use.  We  refer  to  the 
former  as  Qol  and  the  later  as  Vol  (for  value  of  informa¬ 
tion),  see  Figure  3. 


Figure  3:  The  Qol/Vol  "split" 

The  Qol/Vol  split  allows  us  to  separate  the  ability  to 
support  assessment  of  the  information,  i.e.,  enabling  the 
process  which  ends  with  the  passing  of  a  judgment  or  a 
verdict  about  the  information  at  hand,  from  the  actual 
judgment  reached  within  the  context  of  particular  applica¬ 
tion.  For  example,  we  separate  the  fact  that  an  image  has, 
say,  resolution  of  0.5  megapixels  from  whether  this  is 
sufficient  resolution  for  a  given  application.  With  such  a 
split  of  the  entire  Qol  premise  in  mind,  the  following 
terms  will  be  used: 
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•  Quality  of  information  (Qol)  represents  the  body  of 
evidence  (described  by  information  quality  attributes) 
used  to  make  judgments  about  the  fitness  (or,  utility) 
of  the  information  contained  in  an  information  stream. 

•  Value  of  information  (Vol)  represents  the  utility  of  the 
information  in  an  information  stream  when  used  in  the 
specific  application  context  of  the  receiver. 

Vol  utility  is  expressed  in  an  application-specific  man¬ 
ner.  With  regard  to  the  information  channel: 

•  Quality  of  service  (QoS)  is  a  characterization  of  the 
transport/transmission  properties  of  the  channel  used 
by  the  source  to  send  information  to  the  receiver. 

Qol  attributes  capture  the  inherent  characteristics  of  in¬ 
formation  that  are  independent  of  the  specific  application 
context  in  which  the  receiver  will  use  the  information. 
These  attributes  include  such  information  characteristics 
as  accuracy,  latency,  and  provenance  (or  integrity).  Since 
some  of  these  inherent  characteristics  could  be  impacted 
by  the  transport  of  information  from  a  source  to  a  receiver, 
we  can  distinguish  between  Qol  emitted  by  a  source  and 
Qol  delivered  to  a  receiver  with  the  channel  QoS  linking 
the  two.  This  is  shown  in  Figure  4  which  is  derived  from 
the  abstract  scenario  in  Figure  2  with  added  emphasis  that 
information  streams  flow  (and  combine)  from  multiple 
sources  to  multiple  receivers  over  multiple  channels. 


Information  Stream 
- > 


Figure  4:  The  QoI/QoS/VoI  chaining 

3.2  The  Qol/Vol  information  processing 
operators 


Figure  5:  Information  processing  operators 
As  information  flows  toward  the  receiver  of  our  ab¬ 
stract  use  scenario,  it  will  be  processed  through  several 
information  processing  operators  prior  to  been  delivered  to 
its  next-user  (the  end-user,  or  the  next  receiver  in  the  end- 
to-end  information  chain).  We  posit  the  existence  of  the 
following  three  types  of  such  information  processing  oper¬ 
ators,  see  Figure  5: 


•  Annotation  operators,  which  attach  new  metadata  to 
an  information  stream; 

•  Modifier  operators,  which  take  an  input  information 
stream,  with  or  without  metadata  and  modify  either 
the  output  information  stream  or  the  metadata;  and 

•  Fusion  operators,  which  combine  two  or  more  infor¬ 
mation  streams. 

Depending  on  the  sensor  deployment  and  system  de¬ 
sign  choices,  these  operators  may  or  may  not  physically 
reside  and  operate  within  each  information  receiver  or 
their  output  is  passed  from  one  receiver  to  the  next.  For 
example  consider  a  shooter  localization  case  where  direc¬ 
tion  of  arrival  (DOA)  data  collected  from  an  acoustic 
array  may  pass  through  a  number  of  receivers  prior  to 
being  presented  as  localization  information  to  end-users. 
DOA  metadata  may  include  the  error  estimate  for  DOA, 
the  location  of  the  acoustic  array,  the  time  of  measure¬ 
ments,  the  ambient  temperature,  and  so  on.  information 
about  DOA  error  may  be  pre-calculated  and  stored  re¬ 
motely  of  the  receivers  and  retrieved  upon  request  as  ne¬ 
cessary  at  any  stage  of  the  end-to-end  path  between  the 
sensors  and  the  end-user.  Certain  metadata  may  not  be 
available  or  computable  at  all  or  only  to  a  limited  degree, 
e.g.,  as  information  crosses  coalition  domain  boundaries, 
provenance  metadata  may  be  constrained  for  certain  pieces 
of  information-in  other  words,  they  may  be  data  quality 
concerns  regarding  the  Qol  metadata  too ! 

Of  particular  interest  in  this  paper  are  two  specific 
types  of  annotation  operators,  the  Qol  annotator  and  the 
Vol  annotator.  The  Qol  annotator  takes  an  incoming  input 
stream  and  attaches  a  Qol  metadata  to  the  information 
stream.  Qol  metadata  are  metadata  attached  to  a  piece  of 
information  that  describes  the  quality  of  information  in 
that  piece.  The  Vol  annotator  takes  a  stream  with  Qol 
metadata  and  attaches  Vol  metadata  to  the  stream.  The 
Vol  metadata  that  are  metadata  attached  to  a  piece  of  in¬ 
formation  describe  the  value  of  the  information  of  that 
piece  for  the  receiver.  The  receiver  uses  a  combination  of 
these  basic  information  processing  operators  to  perform  its 
functions.  Different  types  of  receivers  may  have  different 
Qol  and  Vol  annotators.  However,  these  annotators  will  be 
specializations  of  a  generic  Qol  and  Vol  annotators  that 
comply  with  the  Qol  and  Vol  base  models  described  short¬ 
ly- 

For  the  sensor  information  itself,  we  assume  that  the 
information  characterizes  the  world  of  interest  that  is 
represented  by  collection  of  interrelated  objects  possessing 
states  in  a  multidimensional  space  (e.g.,  the  current  loca¬ 
tion,  the  direction  of  movement,  the  strength,  the 
friend/foe  allegiance,  etc.,  of  a  troop  formation).  Each 
piece  of  information  pertains  to  some  range  of  parameters 
in  this  multidimensional  space.  In  some  sense  Qol  relates 
to  how  good  (accurate,  timely,  etc.)  these  parameter  esti¬ 
mates  are  and  Vol  represents  how  desirable  these  parame¬ 
ter  estimates  are  -how  desirable  the  parameters  are  in  the 
first  place,  and  how  acceptable  the  goodness  of  these  esti¬ 
mates  are  for  the  task  at  hand. 
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4  Qol  metadata  model 

It  is  a  key  objective  of  our  work  to  develop  a  structure 
for  expressing  and  communicating  Qol  and  Vol  metadata 
in  an  application-agnostic  manner.  While  we  realize  that 
the  true  value  of  Qol  and  Vol  metadata  representation  can 
only  be  obtained  in  the  context  of  a  specific  application, 
there  are  many  commonalities  in  the  metadata  representa¬ 
tion  across  multiple  applications,  and  a  common  model 
serves  to  call  out  those  similarities  as  well  as  provide  the 
base  from  which  customizations  can  be  made.  While  dif¬ 
ferent  application  contexts  have  their  own  instances  of 
metadata  that  are  appropriate,  it  is  our  assertion  that  a 
large  variety  of  such  Qol  metadata  have  common  charac¬ 
teristics  which  can  be  specified  in  a  base  metadata. 

In  order  to  specify  the  Qol  and  Vol  metadata  without 
getting  embroiled  in  the  intricacies  of  defining  a  metadata 
format,  we  have  opted  to  represent  the  metadata  by  means 
of  an  abstract  data  model.  The  data  model  is  represented 
using  the  unified  modeling  language  (UML)  [10].  UML  is 
a  method  to  graphically  represent  object-oriented  data. 
The  structure  of  the  data  (types  of  data,  specific  attributes) 
is  described  visually  as  a  set  of  classes  or  objects  with 
shared  attributes.  Links  between  the  different  classes 
represent  relationships  such  as  aggregation,  association 
and  inheritance. 

UML  has  proven  an  effective  means  for  supporting 
both  the  communication  and  sharing  of  research  results  in 
measurement  and  improvement  of  information  quality 
[14].  The  structures  studied  in  this  manner  have  been  used 
to  reason  about  information  quality  in  tactical  systems.  For 
example,  in  [15]  the  authors  achieve  a  remarkable  clarity 
of  expression  of  the  positive  and  negative  influences  on 
risk  in  the  quality  of  information  in  an  abstraction  of  a 
tactical  system  based  on  rates  of  information  provision  of 
various  types.  The  quality  of  that  information  is  measured 
in  a  subset  of  the  essential  quality  attributes  (correctness, 
consistency,  etc.)  [4]  chosen  to  fully  specify  the  beha¬ 
viours  of  pertinent  (time -evolving)  information  products 
produced  in  NCO  situations. 


4.1  The  base  Qol  data  model 


Information 

1 

BaseQol 

Context 

hasQuality 

QolQualifier 


AppDomainCntx 

name:  string 
description:  URL 
standardName:  string 
standardDescription:  URL 


QolSpatialCntxAttr 

QoITemporalCntxAttr 

name:  string 

lowerBound:  QolMetric 
upperBound:  QolMetric 

name:  string 

lowerBound:  int 
upperBound:  int 

Qol  attributes 


Figure  6:  The  base  Qol  data  model 
The  base  Qol  data  model  that  is  shared  by  all  applica¬ 
tion  contexts  is  shown  in  Figure  6.  The  base  Qol  model 
comprises  a  collection  of  UML  classes,  which  are  grouped 
together  into  a  set  of  common  classes  to  provide  a  struc¬ 


ture  for  the  model.  The  specification  of  all  of  the  classes  in 
the  base  model  provides  the  metadata  representing  Qol  for 
a  piece  of  information. 

The  BaseQol  class  represents  the  base  class  for  the 
Qol  metadata.  The  BaseQol  class  is  associated  with  a 
piece  of  information,  which  is  represented  by  the  Infor¬ 
mation  class.  The  BaseQol  class  is  also  associated  with  a 
context,  which  is  represented  by  the  Context  class.  The 
Context  class  is  an  abstract  representation  for  a  collec¬ 
tion  of  several  context  attribute  classes,  which  includes  the 
physical  context  of  spatial  (QolSpatialCntxAttr)  and 
temporal  (QoITemporalCntxAttr)  attributes.  QolSpa¬ 
tialCntxAttr  contains  the  spatial  bounds  (geographical 
horizon)  for  which  the  Qol  metadata  are  valid  for  the  in¬ 
formation.  Likewise,  QoITemporalCntxAttr  contains 
the  temporal  bounds  (time  horizon)  for  which  the  Qol 
metadata  are  valid  for  the  information.  These  two  physical 
context  attributes  support  the  when  and  where  relevancy 
primitives  of  the  Qol-inspired  5WH  information  summari¬ 
zation  principle  [16].  In  addition  to  the  physical  context, 
there  is  also  an  application  context  class  (AppDo¬ 
mainCntx)  that  associates  the  information  and  its  Qol 
metadata  with  the  specific  application  domain  (AppDo¬ 
mainCntx)  for  which  the  Qol  valid.  Any  specific  instance 
of  Qol  metadata  would  have  an  instance  of  AppDo¬ 
mainCntx  describing  the  context  for  which  the  Qol  is 
being  defined.  Finally,  the  QolQualifier  class  contains 
metadata  about  a  particular  instance  of  a  Qol  data  model, 
including  its  author,  time  of  authoring,  publisher,  and  so 
on. 


_ QolAccuracyAttr 

volatility:  QolEnumeratedMetric 
detail  Level:  QolEnumeratedMetric 
volume:  QolQuantitativeMetric 
consistency  :QolEnumeratedMetric 
resolution:  QolQuantiativeMetric 
bias:  QolQuantiativeMetric 
errorLevel:  QolEnumeratedMetric 
v errorRate :  QolEnumeratedMetric 


-  -  -  -  |  Qol  attributes  | 


_ QolTimelinessAttr _ 

latencySource:  double 
latencyPath:  double 
validityExpiration:  double 
timelinessLevel:  QolEnumeratedMetric 


_ QolIntegrityAttr _ 

sourcelntegrity:  QolMetric 
channellntegrity:  QolMetric 
auditability:  QolEnumeratedMetric 
attestability:  Qol  E n u m erated  M et ric 
confidentiality:  QolEnumeratedMetric 


Qol  Format  Attr 

encoding:  double 

conciseness:  QolEnumeratedMetric 


Figure  7;  The  Qol  attribute  classes 
The  QolBaseAttr  class  represents  an  abstract  place¬ 
holder  for  a  collection  of  Qol  attribute  classes  grouping 
related  Qol  attributes.  Figure  7  depicts  four  attribute 
classes  representing  the  Qol  attributes  for:  accuracy 
(QolAccuracyAttr),  timeliness  (QolTimelines¬ 
sAttr),  integrity  (QolIntegrityAttr),  and  format 
(QolFormatAttr ) .  The  QolFormatAttr  class  can  be 
viewed  as  a  representation  of  the  quality  of  data,  which 
measures  quality  related  to  the  formatting  of  the  informa¬ 
tion  as  data.  Each  of  these  classes  comprises  a  collection 
of  pertinent  Qol  attribute  class  parameters,  such  as  those 
shown  in  the  figure.  The  collection  of  attribute  classes  and 
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associated  parameters  in  the  figure  is  not  meant  to  be  ex¬ 
haustive.  They  can  both  be  augmented  or  subclassed  de¬ 
pending  on  the  needs  of  the  application  domain  specified 
by  the  AppDomainCntx  class.  Also,  class  parameter  may 
(or  may  not)  be  used  in  a  specific  application  context. 


4.2  The  Qol  metric  data  model 

Most  of  the  class  parameters  in  the  Qol  attribute 
classes  are  of  type  QolMetric.  In  strict  UML  terminolo¬ 
gy,  these  should  be  shown  as  associations  to  a  class  Qol¬ 
Metric.  However,  for  our  own  application,  it  is  more 
concise  and  intuitive  to  deviate  from  strict  conventions 
and  assume  that  a  base  class  of  type  QolMetric  is  availa¬ 
ble  to  characterize  individual  attribute  class  parameters. 
QolMetric  is  a  general  class  that  stands  for  either  a  quan¬ 
titatively  computed  number  or  an  enumerated  value,  see 
Figure  8.  The  enumeration  may  rank  specific  attributes  in 
discrete  value.  As  an  example,  one  may  measure  the  sour- 
celntegrity  parameter  of  QollntegrityAttr  on  a  scale 
of  1  to  10  signifying  increasing  level  of  integrity.  Alterna¬ 
tively,  one  many  define  sourcelntegrity  as  belonging  to 
one  of  four  types:  untrusted,  erratic,  trusted,  or  authori¬ 
tative.  The  set  of  allowed  values  depends  on  the  context  of 
specific  application  domain. 


Figure  8:  The  Qol  metric  data  model 

4.3  The  base  Vol  data  model 

In  a  manner  analogous  to  Qol,  we  have  also  defined  a 
base  model  for  Vol,  see  Figure  9.  The  UML  diagram  in 
the  base  model  has  several  similarities  to  that  of  the  Qol 
base  model:  the  Context  class  plays  similar  role  to  that  in 
Qol  and  the  BaseVol  class  contains  a  collection  of  Vol 
attributes  classes  subclassed  from  the  VolBaseAttr  class. 
Since,  Qol  attributes  are  used  to  assess  Vol,  the  BaseVol 
class  is  also  associated  with  the  corresponding  BaseQol 
class  of  the  particular  piece  of  Information. 


Information 

1  1 

BaseVol 

Context 

hasValue 

■  ' 

VolBaseAttr 

name:  string 

AppDomainCntx 

name :  string 
description:  URL 
standardName :  string 
standardDescription:  URL 


VolTrustAttr 

VolUsefulnessAttr 

VolConvenienceAttr 

sourceReputation:  QoiMetric 
channelReputation:  QolMetric 
sourceObjectivity:  QolMetric 

novelty:  QoiMetric 
relevance:  QolMetric 
timeliness:  QolMetric 
completeness:  QolMetric 

easeOfUse:  QoiMetric 
forma tCompatibility:  Qo  1  Met ri c 
composability:  QolMetric 

Figure  9:  The  base  Vol  data  model 


The  VolBaseAttr  represents  an  abstract  placeholder 
for  a  collection  of  Vol  attribute  classes  grouping  related 
Vol  attributes.  Figure  9  shows  three  such  attribute  group¬ 
ings  related  to  information  trust,  usefulness  and  conveni¬ 
ence  of  using  the  information  by  the  receiver.  As  in  the 
case  with  the  Qol  attributes,  the  collection  of  Vol  attribute 
classes  and  associated  parameters  in  the  figure  is  not 
meant  to  be  exhaustive. 

The  VolTrustAttr  class  comprises  the  reputation  of 
the  source  of  the  information,  the  channel  through  which 
the  information  arrives,  and  the  objectivity  of  the  source 
all  as  perceived  by  the  receiver.  The  objectivity  of  the 
information  is  a  measure  of  the  fidelity  with  which  the 
receiver  expects  the  source  to  be  reporting  the  information. 

The  VolUsefulnessAttr  class  captures  the  useful¬ 
ness  of  information  in  a  specific  context  as  determined  by 
the  receiver.  The  usefulness  is  assessed  along  four 
attributes,  one  indicating  the  level  of  novelty  of  the  infor¬ 
mation  received,  a  second  measuring  whether  the  informa¬ 
tion  achieved  is  relevant  for  the  needs  of  the  receiver,  a 
third  expressing  how  timely  the  information  is  for  the 
purpose  of  the  receiver,  and  a  fourth  expressing  the  level 
of  completeness  of  the  information.  The  completeness  of 
the  information  measures  the  degree  by  which  the  infor¬ 
mation  at  hand  covers  all  that  is  needed  and  sought  for  by 
the  receiver.  This  parameter  may  accept  both  quantitative 
or  enumerated  values,  novelty  may  be  an  enumerated 
attribute  with  values:  redundant,  corroborative,  incre¬ 
mental,  new,  or  surprising! 

The  VolConvenienceAttr  class  captures  how  easy 
or  difficult  it  is  for  the  receiver  to  use  the  information  and 
is  assessed  along  three  attributes.  The  easeOfUse  attribute 
assesses  whether  the  information  is  perceived  to  be  easy  to 
use  by  the  user.  The  format  of  the  information,  whether  it 
is  readily  usable  by  the  systems  of  the  receiver  or  requires 
manipulation  is  assessed  by  the  formatCompatibility 
attribute.  Finally,  composability  measures  whether  the  data 
can  be  easily  composed  with  other  pieces  of  information 
available  to  the  user.  The  composability  may  be  affected 
by  the  ability  of  the  user  to  process  the  elements  in  its 
electronic  system. 

Taken  together,  these  attribute  classes  provide  an  as¬ 
sessment  of  how  much  value  a  piece  of  information  deliv¬ 
ers  to  the  user  of  the  information  serviced  by  the  particular 
receiver. 

5  A  Qol  metadata  example 

In  this  section,  we  present  an  example  of  an  applica¬ 
tion  and  show  pertinent  Qol  and  Vol  attributes. 

5.1  The  application:  Shooter  localization 

We  consider  a  sensor  system  comprising  a  collection 
of  acoustic  arrays  (the  system  nodes)  deployed  to  support 
a  shooter  localization  application.  Each  node  can  localize  a 
target  by  measuring  the  DOAs  of  the  muzzle  blast  and 
shockwave  and  the  time  difference  of  arrival  (TDOA) 
between  the  muzzle  blast  and  shockwave,  for  further  de- 
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tails  see  [17].  The  application  produces  an  information 
product  (i.e.,  its  output)  comprises  two  numerical  parame¬ 
ters  representing  the  state  of  the  shooter:  (a)  shooter  loca¬ 
tion,  and  ( b )  direction  of  shooting  (both  expressed  relative 
to  a  reference  coordinate  system).  Optionally,  the  informa¬ 
tion  product  may  also  include  the  type  of  gun  used.  The 
value  of  this  product  is  assessed  based  on  the  accuracy  in 
estimating  the  elements  of  the  shooter’s  state. 

The  information  product  is  produced  by  processing 
(fusing)  measurements  from  multiple  nodes  using  a  locali¬ 
zation  algorithm.  To  be  able  to  assess  the  value  of  the 
product,  the  following  must  also  be  known  about  the  mea¬ 
surements:  («)  errors;  (b)  provenance,  e.g.,  the  location  of 
the  acoustic  arrays;  (c)  timestamps  for  the  DOA  measure¬ 
ments;  and  id)  a  classification  of  the  raw  data  used  to 
compute  the  DOA,  e.g.,  gun  type  based  on  gunfire  signa¬ 
tures.  The  last  two  are  useful  to  properly  correlate  reports 
from  multiple  nodes  to  the  same  shooting  event,  or  the 
same  shooter. 

Next  we  summarize  the  pertinent  metadata  to  support 
the  Vol  assessment  of  the  information  provided  by  this 
application.  To  specialize  the  UML  base  model  to  this 
specific  instance,  we  would  define  extension  classes  in  the 
UML  model  to  define  additional  information  to  augment 
the  base  Qol  and  Vol  model. 

Information  I  QolAccuracvAttr  I  I  QolIntegritvAttr  1 

A  _ _6_ _ 7 

LocationAppQolAccuracy 

snr :  real 
range:  real 

temporalResolution:  real 

LocationAppInformation 

shooterPosition:  Coordinate 
shooterDirection:  Coordinate 
sensorPosition:  Coordinate 
sensorTime:  double 
\ _ 

Figure  10:  The  Qol  classes  for  shooter  application 

5.2  The  quality  metadata 

In  the  shooter  location  example,  we  will  subclass  two 
of  the  classes  (QoIAccuracyAttr  and  QoIIntegri- 
tyAttr)  of  the  base  Qol  metadata  UML  model.  The  sub¬ 
classes  provide  additional  information  that  can  be  used  to 
provide  details  for  Qol  attributes  defined  in  the  base  case. 
These  extensions  for  the  Qol  classes  are  shown  in  Figure 
10.  The  figure  also  shows  the  model  for  a  single  unit  of 
information  provided  by  the  sensors  in  this  case.  Each  unit 
of  information  contains  the  location  and  direction  of  the 
sensor,  the  position  of  the  sensor,  and  the  time  when  the 
measurement  was  taken. 

Qol-related  metadata 

Extension  of  Accuracy  Attributes 

To  calculate  the  Qol  attributes  related  to  accuracy, 
three  additional  pieces  of  information  are  added  to  the 
accuracy  attribute  in  the  extended  class  LocationApp¬ 
QolAccuracy,  which  is  a  subclass  of  QoIAccura¬ 
cyAttr.  This  information  contains  the  signal-to-noise 
ratio  (SNR),  range,  and  temporal  resolution  of  the  sensor. 
This  information  could  be  found  in  product  literature  and 
retrieved  on  demand  by  providing  a  pointer  to  it. 


Extension  of  Integrity  Attributes 

The  additional  information  needed  to  estimate  the  inte¬ 
grity  of  the  information  is  the  owner  of  the  sensor,  be¬ 
cause,  for  example,  assets  belonging  to  other  partners  in  a 
coalition  may  have  a  lower  integrity;  the  model  of  the 
sensor;  and  the  power  level  at  which  the  sensor  was  oper¬ 
ating  when  the  measurements  were  made.  Different  levels 
of  integrity  can  be  assigned  to  sensors  operating  at  differ¬ 
ent  levels  of  power. 

On  the  basis  of  both  these  extensions,  the  different 
attributes  of  the  Qol  of  any  unit  of  information  can  be 
computed.  The  Qol  metadata  fields  can  be  computed  and 
assigned  different  levels  based  on  the  details  of  the  differ¬ 
ent  metrics. 

Algorithm  requirements  (sensor  Qol  outputs) 


Figure  11:  The  location  estimation  algorithms 

Figure  11  shows  the  collection  of  estimation  algo¬ 
rithms  for  shooter  location  that  could  be  used,  the  inputs 
that  they  use  and  the  outputs  that  they  produce.  As  the 
figure  shows,  the  localization  algorithm  will  typically 
operate  on  the  combination  of  the  outputs  from  the  DOA- 
and  TDOA-based  algorithms  prior  to  producing  its  own 
output.  Clearly  the  accuracy  of  the  output  results  depends 
on  the  accuracy  of  the  inputs,  their  amount,  and  the  cha¬ 
racteristics  of  the  specific  algorithms  employed.  Thus,  in 
this  case,  a  Qol  annotator  operator,  see  Figure  5,  will  op¬ 
erate  on  the  incoming  information  stream  (the  various 
measurements)  and  their  Qol  metadata  (e.g.,  the  errorLe- 
vel  in  QoIAccuracyAttr).  It  will  produce  an  outgoing 
information  stream  (the  information  product  related  to  the 
shooter’s  state,  i.e.,  his  location  and  direction)  each  with 
its  own  errorLevel  parameter  that  is  calculated  from  the 
corresponding  input  parameters  and  capabilities  of  the 
location  estimation  algorithms. 

Vol-r elated  metadata 

In  order  to  determine  the  Vol  in  this  example,  we  do 
not  need  to  extend  the  base  UML  classes,  but  can  use  them 
as  is.  The  value  of  the  particular  information  product  can 
be  assessed  along  various  dimensions  captured  by  the  Vol 
attributes,  see  Figure  9: 

Vol  Trust:  This  is  assessed  based  on  the  trust  level  of 
various  entities  such  as  the  sources  (e.g.,  the  reputation  of 
the  sensors,  nodes),  their  owners  (e.g.,  various  coalition 
members),  and  knowledge  of  the  algorithms  used  (which 
impacts  the  trust  on  the  reported  information  product  and 
Qol  metadata).  This  can  be  measured  in  a  3 -point  scale  of 
Low,  Medium  and  High. 


LocationAppQolIntegrity 

owner:  String 
sensorModel:  String 
sensorPower:  String _ 
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Vol  usefulness'.  This  is  assessed  based  on  the  proximity 
to  desired  values  of  the  reported  mean  square  error  (MSE) 
of  the  location,  shooting  orientation,  and  time  of  event;  the 
delay  in  reporting  the  event  (timeliness);  and  the  com¬ 
pleteness  of  the  coverage  of  the  reports,  e.g.,  the  parentage 
of  spatiotemporal  coverage  provided  by  the  sensor  nodes. 

Vol  convenience :  This  is  assessed  with  respect  to 
“compatibility”  of  information  product  to  the  expectations 
of  its  recipient.  Increasing  the  Vol  convenience  may  re¬ 
quire  the  syntactic  transformation  of  the  information  prod¬ 
uct  whenever  possible  and  necessary,  e.g.,  translate  be¬ 
tween  measurement  units  when  the  product  is  provided  to 
other  coalition  members,  or  provide  a  composite  product 
such  as  “wind-chill  factor”  from  constituent  estimates  of 
“ambient  temperature”  and  “wind  speed.” 

It  should  be  noted  that  coalition  members  may  prefer 
not  to  divulge,  for  example,  the  exact  location  or  capabili¬ 
ties  of  their  own  sensors  to  certain  other  members  by  alter¬ 
ing  the  entries  of  pertinent  Such  deliberate  modifications 
of  metadata  form  the  basis  for  risk-based  distribution  of 
military  information  between  coalition  members  [18]. 

6  Summary 

Effective  information  sharing  is  a  necessary  condition 
for  effective  coalition  operations  supporting  the  NCO 
objectives.  The  effective  sharing  of  ever  increasing 
amounts,  types,  shapes,  and  forms  of  dynamically  pro¬ 
duced,  sensor-originated  information  among  coalition 
members  requires  a  common,  flexible  indexing,  searching, 
and  retrieval  means  to  be  established.  Motivated  by  the 
importance  that  quality  information  plays  in  improved 
situation  awareness,  effective  decision  making  and  action 
taking,  in  this  paper  we  have  proposed  using  Qol  and  Qol- 
related  metadata  for  supporting  the  above. 

To  cope  with  the  broad  reach  of  Qol,  we  have  pro¬ 
posed  its  split  it  into:  (a)  a  Qol  part  that  relates  to  the  inhe¬ 
rent  quality  properties  of  sensor-originated  information 
(including  accuracy,  latency,  and  provenance);  and  (b)  a 
Vol  part  that  relates  to  the  value  of  the  information  within 
the  context  of  an  application.  Based  on  this  split,  we  have 
introduced  an  abstract  UML-based  data  model  for  Qol  and 
Vol  metadata.  The  data  model  provides  a  general  template 
for  organizing  Qol  and  Vol  metadata  in  support  of  Qol- 
centered  annotation  operations  of  information.  Using  this 
template,  instances  of  the  model  can  be  produced  for  spe¬ 
cific  application  contexts  in  a  consistent,  reproducible,  and 
repeatable  manner. 

The  proposed  data  model  represents  only  a  first  step 
toward  Qol-aware  NCO  operations.  It  codifies  the  infor¬ 
mation  that  is  to  be  exchanged  between  Qol-aware  sys¬ 
tems.  To  build  and  operate  these  systems,  though,  requires 
establishing  a  trusted,  auditable  infrastructure  for  commu¬ 
nicating  the  Qol  medatada  and  architecting  and  building 
the  intelligence  for  processing  them,  like  the  annotators  in 
Figure  5.  This  is  not  a  small  feat  and  leaves  plenty  a  re¬ 
search  questions  for  future  considerations.  The  aforemen¬ 
tioned  secure  metadata  frameworks  [18]  and  policy-based 
coalition  operations  [19]  are  promising  paths  to  consider. 
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